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METHOD OF REGISTERING SURFACES USING CURVATURE 

BACKGROUND OF THE INVENTION 
5 The invention relates to a method of registering surfaces 

using curvature data and in particular to a method of registering a 

patient surface created from patient range data with a model surface 

created from patient image data. 

Three-dimensional models of a patient, derived using 

10 medical imaging techniques (e.g. CT, MR), are useful in both planning 
and performing surgical procedures. U.S. Patent 5,740,802, assigned 
to the assignee of the present application, discloses a system that 
aligns live video of the patient and models generated from medical 
imaging to facilitate surgery. In smooth regions, without prominent 

15 landmarks, it is difficult to align the image data with the model data. 

- BRIEF SUMMARY OF THE INVENTION 

An exemplary embodiment of the invention is directed to 
a method of registering a generated patient surface with a model 
20 surface based on curvature. The method includes acquiring patient 
range data and determining the patient curvature based on the range 
data. A patient surface is generated and shaded based on the patient 
curvature. A model surface is generated from image data and 
processed to determine the curvature of the model surface. The 
25 model surface is shaded to represent the model curvature. The 
shaded patient surface and the shaded model surface may be aligned 
by manipulating the patient surface and/or the model surface until the 
curvature features coincide. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a flowchart depicting a method of registering 

two surfaces; 

Figure 2 illustrates a patient surface which has been 
5 shaded with curvature; 

Figure 3 illustrates a model surface shaded with 
curvature; and 

Figure 4 illustrates the patient surface oriented with the 
model surface. 

10 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 illustrates, in flowchart form, a method of 
registering a patient surface with a model surface in an exemplary 
embodiment of the invention. At step 1 0, range data are obtained from 

15 the patient. The range data may be derived from direct measurement 
(e.g. optical range data, coordinate measuring machines, etc.). At step 
20, image data representing the patient are obtained and may be 
provided from a variety of medical imaging techniques. At step 12, the 
curvature of the range data is determined using either the mean 

20 curvature or the Gaussian curvature described herein. 

At step 22, a model is created from the image data and 
the model surface curvature is determined. A system for creating 
surfaces from volumetric data has been described in U. S. Patent 
4,821,213, Cline, Ludke, Lorensen, April 11, 1989, "System For The 

25 Simultaneous Display Of Two Or More Internal Surfaces Within A Solid 
Object" ("Marching Cubes Method"). The "Marching Cubes Method" 
produces surfaces efficiently; however as the number of volumetric 
data points becomes larger, it becomes more feasible to use another 
method, specifically that described in U. S. Patent 4,719,585, Jan. 12, 

30 1988, Cline, Ludke, Lorensen, "Dividing Cubes System And Method 
For The Display Of Surface Structures Contained Within The Interior 
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Region Of A Solid Body" ("Dividing Cubes Method"). The dividing 
cubes method subdivides each voxel into points and normals using 
trilinear interpolation. The points and normals represent surfaces 
which are rendered. A modified marching cubes method may be used 

5 in step 22 to create the model surface and determine the curvature of 
the model surface. The marching cubes method yields a surface 
composed of triangles which may be used to calculate the curvature 
using the method of Gabriel Taubin described in IBM Research Report 
RC-19860 entitled "Estimating the Tensor of Curvature of a Surface 

10 from a Polyhedral Approximation." The model surface is shaded to 
indicate curvature at step 24. The shading may be any visible indicia 
(e.g. color or gray scale) and different indicia are used to indicate 
different curvature values. Figure 3 illustrates a polygonal model 110 
of the patient shaded to indicate curvature. 

15 At step 14, a patient surface corresponding to the range 

data is generated and this patient surface is shaded to indicate the 
curvature. The patient surface may be generated from the range data 
by representing the range data with triangles lying in a plane (e.g. x-y 
plane) and then deforming the plane in another dimension (e.g. z) to 

20 obtain a polygonal model. Figure 2 illustrates the patient surface 100 
shaded to indicate curvature. 

At steps 16 and 26, the shaded patient surface and the 
shaded model surface, respectively, are displayed. At step 18, 
orientation of the patient surface is varied so that the patient surface is 

25 aligned with the model surface. It well be understood that the model 
surface may be varied in orientation or the orientation of both the 
patient surface and the model surface may be varied to align the two 
images. Figure 4 illustrates the patient surface 100 oriented in the 
same manner as the model surface of Figure 3. At step 30, the 

30 images of the patient surface and model surface are mixed and 
displayed. 
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The process of determining the curvature of the patient 
surface shown in step 12 is now be described. Curvature is defined for 
a surface as the rate of change of the normal vector with arc length. 
For a surface, there are two principle curvatures. In a Cartesian 
5 coordinate system, at a point on the surface with the normal direction 
lying along the z -axis, the change in normal vector dn is related to the 
displacements dx and dy in the surface as follows: 
dn x =kxxdx + kxydy 
dn y =k yx dx + kyydy 

10 

where kxx, kxy, ky X and kyy are curvature constants. 



The mean curvature K m =(kxx + kyy)/2 and the Gaussian 
curvature K g = kxxkyy - kxyk yx are surface properties and remain invariant 
15 for rotations of the surface. The rotational invariance of both the mean 
curvature and the Gaussian curvature are useful in displaying the 
patient surface with curvature shading. If the patient surface 
orientation is varied, the curvature shading will not vary, which 
facilitates alignment of the patient surface and the model surface. 
20 The curvature constants, nine altogether, are calculated 

from the patient data by taking the central differences of the normal 
vectors along the three axes 

kxx = [n x (x+a, y, z) - n x (x-a, y, z)] /2a 
k^ = [n x (x, y+b, z) - n x (x, y-b, z)] /2b 
25 kxz = [n x (x, y, z+c) - n x (x, y, z-c)]/2c 



etc 



30 
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kzz = [n z (x, y, z+c) - nz ( x, y, z-c)]/ 2c 

where a, b, c are the spacings between sampled points. 
5 The mean curvature for a surface with arbitrary orientation is given by 
the trace of the 3x3 curvature matrix 

k m = (kxx +k yy +k zz )/2 

io and the Gaussian curvature is given by the sum of the 

diagonal minor determinants 

kg = (kxx kyy " kxy kyx) + (kyykzz " ky Z k z y) + (kzz kxx " kyz kzx). 

15 In the case of the normal vector lying along a principle 

axis, these formulas reduce to the usual special cases for the surfaces 
described above. 

The invention can be embodied in the form of computer- 
implemented processes and apparatus for practicing those processes. 

20 The invention can also be embodied in the form of computer program 
code containing instructions embodied in tangible media, such as 
floppy diskettes, CD-ROMs, hard drives, or any other computer- 
readable storage medium, wherein, when the computer program code 
is loaded into and executed by a computer, the computer becomes an 

25 apparatus for practicing the invention. The invention can also be 
embodied in the form of computer program code, for example, whether 
stored in a storage medium, loaded into and/or executed by a 
computer, or transmitted over a communication medium such as 
electrical wiring or cabling, fiber optics, or via electromagnetic 

30 radiation; in each instance, when the computer program code is loaded 
into and executed by a computer, the computer becomes an apparatus 
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for practicing the invention. When implemented on a general-purpose 
microprocessor, the computer program code segments configure the 
microprocessor to create specific logic circuits. 

While only certain preferred features of the invention 
5 have been illustrated and described, many modifications and changes 
will occur to those skilled in the art. It is, therefore, to be understood 
that the appended claims are intended to cover all such modifications 
and changes as fall within the true spirit of the invention. 



WHAT IS CLAII 




:D IS: 



A method for registering surfaces comprising: 
acquiring a first surface from a body having curvature to 

be imaged; 



curvature; 

shading said second surface in response to said second 
curvature; and 

varying orientation of at least one of said first surface and 
said second surface to align said first surface and said second surface 
in registration with each other. 

2. The method for registering surfaces of claim 1 
wherein the step of determining a first curvature comprises determining 
a mean curvature. 

3. The method for registering surfaces of claim 2 
wherein, in a Cartesian coordinate system, said mean curvature is 
represented as 

Km^kxx+kyy)^, 

where kxx = [n x (x+a, y, z) - n x (x-a, y, z)] /2a; and 
kyy = [n y (x, y+b, z) - n y (x, y-b, z)] /2b, and wherein n x and 
n y represent vectors in the x and y directions, respectively, when the 
direction normal to each of said first and second curvatures is in the z 
direction, and a, b, and c are the spacings between sampled points. 

4. The method for registering surfaces of claim 1 
wherein the step of determining a first curvature comprises determining 
a Gaussian curvature. 



acquiring a second surface from said body; 
determining a first curvature of said first surface; 
determining a second curvature of said second surface; 
shading said first surface in response to said first 



5. The method for registering surfaces of claim 4 
wherein said Gaussian curvature is represented as 



Kg — kxxkyy - kxykyx, 

where kxx = [n x (x+a, y, z) - n x (x-a, y, z)] /2a; 

kyy = [n y (x, y+b, z) - n y (x, y-b, z)] /2b; 

kxy = [n x (x, y+b, z) - n x (x, y-b, z)] /2b; and 

k yx = [n y (x+a, y, z) - n y (x-a, y, z)] /2a, and wherein n x and 



n y represent vectors in the x and y directions, respectively, when the 
direction normal to each of said first and second curvatures is in the z 
direction, and a, b, and c are the spacings between sampled points. 



6. The method for registering surfaces of claim 1 



wherein the step of determining a second curvature includes the step 
of processing said second surface with marching cubes. 



7. The method for registering surfaces of claim 1 



wherein said first surface represents a patient and is generated from 
patient range data. 



8. The method for registering surfaces of claim 1 



wherein said second surface represents a patient and is generated 
from image data. 



9. The method for registering surfaces of claim 7 



wherein said second surface represents the patient and is generated 
from image data. 



to. A storage medium encoded with machine-readable 



computer program code for registering surfaces comprising instructions 
for causing a computer to implement a method of: 

acquiring a first surface from a body having curvature to 

be imaged;; 

acquiring a second surface from said body; 
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determining a first curvature of said first surface; 
determining a second curvature of said second surface; 
shading said first surface in response to said first 

10 curvature; 

shading said second surface in response to said second 
curvature; and 

varying orientation of at least one of said first surface and 
said second surface so as to align said first and second surface in 
15 registration with each other. 

11. The storage medium of claim 10 wherein the first 
curvature is a mean curvature. 

12. The storage medium of claim 11 wherein, in a 
Cartesian coordinate system, said mean curvature is represented as 

K m =(k xx + kyy)/2 

where k** = [n x (x+a, y, z) - n x (x-a, y, z)] /2a, and 
5 kyy = [n y (x, y+b, z) - n y (x, y-b, z)] /2b, and wherein n x and 

n y represent vectors in the x and y directions, respectively, when the 
direction normal to each of said first and second curvatures is in the z 
direction, and a, b, and c are the spacings between sampled points. 

13. The storage medium of claim 10 wherein the first 
curvature is a Gaussian curvature. 

14. The storage medium of claim 13 wherein said 
Gaussian curvature is represented as 

Kg = kxxkyy " kxykyx, 

where k^ = [n x (x+a, y, z) - n x (x-a, y, z)] /2a; 
5 kyy = [n y (x, y+b, z) - n y (x, y-b, z)] /2b; 

kxy = [n x (x, y+b, z) - n x (x, y-b, z)] /2b; and 
kyx = [n y (x+a, y, z) - n y (x-a, y, z)] /2a, , and wherein n x 
and n y represent vectors in the x and y directions, respectively, when 
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the direction normal to each of said first and second curvatures is in 
10 the z direction, and a, b, and c are the spacings between sampled 
points. 

15. The storage medium of claim 10 wherein said 
medium is adapted to determine said second curvature by processing 
said second surface with a marching cubes process. 

16. The storage medium of claim 10 wherein said first 
surface represents a patient and said storage medium includes 
instructions for causing the computer to generate said first surface 
from patient range data. 

17. The storage medium of claim 10 wherein said 
second surface represents a patient and said storage medium includes 
instructions for causing the computer to generate said second surface 
from patient image data. 

18. A storage medium of claim 16 wherein said second 
surface represents a patient and said storage medium includes 
instructions for causing the computer to generate said second surface 
from patient image data. 
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ABSTRACT OF THE DISCLOSURE 

A patient surface is registered with a model surface 
based on curvature by acquiring patient range data and determining 
the curvature of the patient surface based on the range data. The 
patient surface is generated and shaded based on the curvature. A 
model surface is generated from image data and processed to 
determine the curvature of the model surface. The model surface is 
shaded to represent the curvature. The shaded patient surface and 
the shaded model surface are aligned in registration with each other by 
manipulating the patient surface and/or the model surface until the 
curvature features coincide. 



10 



Orient*] 







Docket Number 
RD-23,019 



DECLARATION FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor (if plural 
names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 
METHOD OF REGISTERING SURFACES USING CURVATURE 



the specification of which is attached hereto unless the following box is checked: 

Q was filed on as United States Application Number or PCT International Application Number 

and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above identified specification, including the claims, as amended 
by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to patentability as defined in Title 37, Code of Federal Regulations 
§1 .56. I hereby claim foreign priority benefits under Title 35, United States Code, §1 1 9(a)-(d) of any foreign application(s) for patent or 
inventor's certificate listed below and have also identified below any foreign application for patent or inventor's certificate having a filing 
d^te^eforejhat of the_appjication_oj] whJch_priority is claimed. 

Prior Foreign Application Priority Claimed 

□ Yes □ No 



(Country) (Day/Month/Year Filed) 



(Day/Month/Year Filed) 



□ Yes □ No 



Ftfereby claim the benefit under Title 35, United States Code, §1 19(e) of any United States provisional application(s) listed 
below. 



(Application Number) (Filing Date) 



yj (Application Number) (Filing Date) 

! Hereby claim the benefit under Title 35, United States Code §120 of any United States Application(s) listed below and, insofar as 
thfe subject matter of each of the claims of this application is not disclosed in the prior United States application in the manner 
pb-vided by the first paragraph of Title 35, United States Code, §1 12, 1 acknowledge the duty to disclose information which is material 
to patentability as defined in Title 37, Code of Federal Regulations, §1 .56 which became available between the filing date of the prior 
application and the national or PCT international filing date of this application. 



(Application Number) (Filing Date) (StahJS . pa{ented pend ^ abandoned) 



(Application Number) (Filing Date) (Status - patented, pending, abandoned) 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application and to transact all business in the Patent 
and Trademark Office connected therewith 

Douglas E. Stoner, Reg. No. 26,509, Marvin Snyder, Reg. No. 20,126, James Magee, Jr., Reg. No. 22,358, Donald S. Ingraham, 
Reg. No. 33,714, Jill M. Breedlove, Reg. No. 32,684, Noreen C. Johnson, Reg. No. 38,929, Ronald E. Myrick, Reg. No. 26,315, 
Henry J. Policinski, Reg. No. 26,621 and Jay L. Chaskin, Reg. No. 24,030. 

Address all telephone calls to: Marvin Snyder at telephone number (518) 387-6189 

Address a,, correspondence <o: II1I1U 

P.O. Box 8, Bldg. K-1 - Salamone $ 1 47 

Schenectady, New York 12301 



Page 1 of 2 



PATENT AND TRADEMARK OFFICE 



u Docket Number 

RD-23,019 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true and further that these statements were made with the knowledge that willful false statements and 
the like so made are punishable by fine or imprisonment or both, under Section 1001 of Title 18 of the United States Code and 
that such willful false statements may jeopardize the validity of the application or any patent issued thereon. 

SOLE OR FIRST INVENTOR: 

Full name: Harvey Ellis Cline 



Signature: 



first Name _ Middle Na 



Residence: Schenectady, New York 



Citizenship: us 



City and State 

Post Office Address: 845 Harris Drive, Schenectady, NY 12309-3003 



SECOND JOINT INVENTOR: 
Full name: Wiiliam Edward Lorense.n 



□Signature: 



FirstName 



njResidence: Ballston Lake, New York 



City and State 

"fp ost Office Address: 14 Hearthside Drive, Ballston Lake, NY 12019 



Citizenship: (JS 



OTHIRD JOINT INVENTOR: 
r^ull name: 



• ^Signature: 

Residence: 

City and State 

Post Office Address: 



Last Name 

Date 



Citizenship: 



FOURTH JOINT INVENTOR: 
Full name: 

First Name 
Signature: 

Residence: 

City and State 
Post Office Address: 



Last Name 
Date 



Page 2 of 2 



